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Abstract 

Let 5 be a set of transpositions that generates the symmetric group Sn, 
where n > 4. The transposition graph T(S) is defined to be the graph with 
vertex set {1, . . . , n} and with vertices i and j being adjacent in T{S) whenever 
€ S. We prove that if the girth of the transposition graph T{S) is at 
least 5, then the automorphism group of the Cayley graph Cay{Sn, S) is the 
semidirect product R{Sn) x Aut(5'n, S), where Aut(5„, S) is the set of automor- 
phisms of Sn that fixes S. This strengthens a result of Feng on transposition 
graphs that are trees. We also prove that if the transposition graph T{S) is 
a 4-cycle, then the set of automorphisms of the Cayley graph Cay(5'4,S') that 
fixes a vertex and each of its neighbors is isomorphic to the Klein 4-group and 
hence is nontrivial. We thus identify the existence of 4-cycles in the trans- 
position graph as being an important factor in causing a potentially larger 
automorphism group of the Cayley graph. 



Index terms — Cayley graphs; transposition sets; automorphism groups; 
modified bubble-sort graph. 



1 Introduction 



Let r = (V, E) be a simple, undirected graph. An automorphism of F is a permutation 
of the vertex set that preserves adjacency; in other words, a permutation vr G Sjm{V) 
is an automorphism of F if for every u,v E V, {u,v} G -E iff {7i{u),7i{v)} G E. The 
set of all automorphisms of F forms a permutation group called the automorphism 
group of F, which we denote by Aut(F). 

Let if be a group and let be a subset of H. The Cayley digraph of H with 
respect to 5", denoted by Caj{H, S), is the digraph with vertex set H and with an 
arc from h to sh whenever h & H and s G 5*. When 5* is closed under inverses, 
{g,h) is an arc of the Cayley digraph if and only if {h,g) is an arc, and so we can 

*Departnient of Mathematics, Amrita School of Engineering, Amrita University, Amri- 
tanagar, Coimbatore - 641 112, Tamil Nadu, hidia. Email: ashwin.ganesan@gmail.com, 
g_ashwin(§cb . amrita. edu. 



1 



identify the two arcs {g, h) and {h,g) with the undirected edge {g, h}. When I ^ S, 
the Cayley digraph contains no self-loops. Thus, when 1^5* = S~^, Cay (if, 5") 
can be considered to be a simple, undirected graph. The Cayley graph Caj{H, S) is 
connected if and only if S generates H. 

The automorphism group of the Cayley graph Cay (if, S) contains the right regular 
representation R{H) as a subgroup, and hence all Cayley graphs are vertex-transitive. 
Let e denote the identity element of the group H and also the corresponding vertex 
of Cay(ii,5). Since R{H) is regular, Aut(r) = Aut(r)ei?(ii), where Aut(r)e is the 
stabilizer of e in Aut(r). The set of automorphisms of the group H that fixes S 
setwise, denoted by Aut(if, S) := {tt G Aut(if) : S'^ = S}, is a subgroup of Aut(r)e 
(cf. [1]). For any Cayley graph T = Cay(ii, S), the normalizer A^Aut(r)(-R(-f^)) is 
equal to the semidirect product R{H) x Aut(ii', S*) (cf. [1], [5). A Cayley graph 
r := Cay (if, 5) is said to be normal if R{H) is a normal subgroup of Aut(r), or 
equivalently, if Aut(r) = R{H) x Aut (ii, 5). Thus, normal Cayley graphs are those 
that have the smallest possible full automorphism group (cf. [8]). 

Let 5 be a set of transpositions in the symmetric group Sn- The transposition 
graph T{S) is defined to be the graph with vertex set {1,2, ... ,n} and with vertices i 
and j being adjacent in T{S) whenever (z, j) G S*. A set of transpositions of {1, ... , n} 
generates Sn if and only if the transposition graph T{S) is connected; thus, a set of 
transpositions is a minimal generating set for Sn if and only if T{S) is a tree (cf. [5j). 
In the sequel, we assume that the set of transpositions S generates Sn', equivalently, 
we assume the graph T{S) is connected. 

Let G denote the automorphism group of a graph F. For a vertex t> of F, let 
denote the stabilizer subgroup of G that fixes the vertex v. Let denote the set of 
automorphisms of F that fixes the vertex v and each of its neighbors. The subgroup 
Ly is called the stabilizer of the vertex neighborhood, and is a normal subgroup 
of (cf. m Chapter 16]). 

While one can often obtain some automorphisms of a graph, it is often difficult to 
prove that one has obtained the (full) automorphism group. A uniqueness property 
that has been has been useful in proving that one has obtained the full automorphism 
group of Cayley graphs Cay(S'„, S) generated by transpositions is the following: given 
any two elements t,k & S, there is either a unique 4-cycle or a unique 6-cycle in the 
Cayley graph Cay(S'„, S) that contains the three vertices e,t and k. This uniqueness 
property implies, via a proof by induction on the length of a word in terms of the 
generating elements S, that any automorphism of the Cayley graph Cay(S'„, S) that 
fixes a vertex and each of its neighbors must be trivial, i.e. that Lg = 1. This implies 
that the Cayley graph Cay(S'„, S) has the smallest possible full automorphism group 
R{Sn) X Aut(S'„,5'). In Godsil and Royle [5], the uniqueness of certain 4-cycles 
in the Cayley graph Cay(5'„, S) was used to determine the automorphism group of 
Cay(S'n, 5") for the special case when T{S) is an asymmetric tree. In Zhang and 
Huang [9], the uniqueness of certain 6-cycles in Cay(S'„, S) was used to determine the 
automorphism group of Cay(S'n, S) for the special case when T{S) is a path graph. 
These results were generalized in Feng [3] to the case where T{S) is an arbitrary tree. 

Let n > 3. Feng [5] showed that if S" is a set of transpositions in Sn, then 
Aut(S'„, S) = Aut (T(S')). This result holds even if T(S') is not a tree. In the special 
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case when T{S) is a tree, Feng [3] showed that the automorphism group of the Cayley 
graph Cay(S'„, S') is the semidirect product R{Sn) x Aut(S'„,S'). In this case, the 
stabihzer Lg of a vertex neighborhood of the Cayley graph Cay(S'„, S) is trivial 

In the present paper, we generalize and extend the results of Feng on trees men- 
tioned in the previous graph to arbitrary transposition graphs that may contain cycles. 
The girth of a graph is the length of the shortest cycle in the graph. In particular, 
trees have infinite girth. We prove that if the girth of the transposition graph is at 
least 5, then the stabilizer subgroup of the Cayley graph Caj{Sn, S) is trivial and 
the automorphism group of the Cayley graph Cay(S'„, S) is the semidirect product 
R{Sn) X Aut(S'„,S'). On the other hand, if T{S) is a 4-cycle, then Le is shown to 
be Klein 4-group and hence is not trivial. These results thus identify 4-cycles in the 
transposition graph as playing an important role in leading to a potentially larger 
automorphism group (of the Cayley graph) than otherwise. 

The main result of this paper is the following: 

Theorem 1. Let S be a set of transpositions that generates Sn, where n > 4. // 
the girth of the transposition graph T{S) is at least 5, then the automorphism group 
of the Cayley graph Cay{Sn, S) is the semidirect product R{Sn) x Aut(S'„, S), where 
Aut(S'„,5') is the set of automorphisms of Sn that fixes S, and the stabilizer of a 
vertex neighborhood of Cay(S'n, S) is trivial. If the transposition graph T{S) is a 4- 
cycle, then the stabilizer of a vertex neighborhood of Cay(S'4, S) is isomorphic to the 
Klein 4-group Z2 x Z2 and hence is nontrivial. 

Remark 1: A special case of the first part of Theorem [1] is the result of Feng 
[3] that if the transposition graph T{S) is a tree, then the automorphism group of 
the Cayley graph Cay(S'„, S") is the semidirect product R{Sn) x Aut(S',i, S"). Further 
special cases of this result are the following: the result of Godsil and Royle [5] that if 
T{S) is an asymmetric tree, then Cay(5'n, S) has automorphism group R(^Sn) — Sn] 
the result of Huang and Zhang [7] that if T{S) is the star Ki^n-i, then Cay(S'„, S) has 
automorphism group isomorphic to SnSn-i', and the result of Zhang and Huang [9] 
that if T{S) is the path graph then Cay(S'„, S) has automorphism group isomorphic 

to Sn'^2 ■ 

Remark 2: There is a flaw in the proof by Zhang and Huang ^ that led to an 
incorrect result in that paper, and the incorrect result there that was recalled and 
stated in Feng |3] as well; we now recall these statements. When the transposition 
graph T{S) is the ra-cycle graph, the Cayley graph Cay(5'„, S) is called the modified 
bubble-sort graph of dimension n. It was claimed in [9] that when T{S) is an n-cycle 
graph for n > 4, then 6-cycles satisfying some particular conditions in the Cayley 
graph Cay(S'„, 5*) are unique. This uniqueness implies that any automorphism of the 
Cayley graph that fixes a vertex and each of its neighbors is trivial. It was stated 
in [3l p. 72] that when T{S) is a 4-cycle, by this uniqueness property, the Cayley 
graph Cay(S'4, S) is normal and has full automorphism group R^S^) x Aut(S'4, S) = 
R{Si)Ge = S^Dg, which contains 192 elements. 
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In the present paper, it is shown that the 6-cycles satisfying certain conditions in 
the Cayley graph Cay(S'4, S) are not unique. In particular, the uniqueness proofs in [5] 
are incorrect, and computer simulations have confirmed our results as being correct. 
Thus, the vertex neighborhood stabilizer Lg in this Cayley graph need not be trivial. 
We determine this stabilizer to be the Klein 4-group Z2 x Z2- With the help of a 
computer (|6j) it was confirmed that the full automorphism group of Cay(5'4, S) has 
768 elements and has structure description (Z2 x Z2 x {{zj x Z3) x Z2)) x Z2- The full 
automorphism group of Cay(5'4, 5") obtained in this paper is in a more comprehensible 
form, i.e. as stated in Theorem [H it is G = R{Si)Ge = R{Si){L^ x Dg) = i?(^4)(^4 x 
D^). In this case, Ri^Si) is not a normal subgroup of Aut(Cay(S'4, S)). 

2 Proof of Theorem [1] 

We assume throughout that S' is a set of transpositions of {1, . . . ,n} that generates 
Sn- Thus the transposition graph T{S) is connected. 

When n = 3 and T{S) is the 3-cycle graph, the Cayley graph Cay(S'„, S) is the 
complete bipartite graph i^3 3 (cf. Biggs [P, Chapter 16]). The complement of K^ 'j, 
is the union of two disjoint 3-cycles. Thus, the automorphism group of K^^^ is the 
automorphism group of a partition of a six element set into two equal sized subsets 
and hence is equal to the semidirect product (5*3 x 5*3) x Z2 (cf. [2;, p. 46]). 

Thus, the cases where n < 3 are easily dealt with; we assume in the sequel that 
n > 4. We first recall a preliminary result. 

Lemma 2. (Godsil and Royle /5, Lemma 3.10.3]) Let S he a set of transpositions 
such that the transposition graph T{S) does not contain triangles, and let t,k E S. 
Then, tk = kt if and only if there is a unique 4-cycle in Cay(S'n, 5) containing e,t 
and k. 

While the hypothesis in Lemma [2] assumes the transposition graph does not con- 
tain triangles, the conclusion in the Lemma holds even if the transposition graph does 
contain triangles; however, this stronger assertion is not useful in our proof because 
when the transposition graph T{S) contains triangles, it turns out that the Cayley 
graph Cay(S'„, S) does not contain unique 6-cycles satisfying certain conditions. The 
uniqueness of both 4-cycles and 6-cycles is necessary in order for the proof to go 
through that Lg is trivial. 

We first consider the case where the transposition graph T{S) is an ra-cycle graph. 
In this case, the set of generators 5* is {(1, 2), (2, 3), . . . , (n — l,n), (n, 1)}, and the 
corresponding Cayley graph Cay(S'„, 5*) is called the modified bubble-sort graph of 
dimension n. We denote these generating transpositions by Sj, where Si = (1, 2), S2 = 
(2,3),...,s„ = (n, 1). 

Lemma 3. Suppose the transposition graph T{S) is an n-cycle, and let G denote the 
automorphism group of Caj{Sn, S) . Then, Ge is the semidirect product Le x D2n, 
where Ge is the stabilizer in G of e and Le is the stabilizer in G of e and each of its 
neighbors. 
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Proof: Let p and a denote the rotation (1, 2, ... , n) and reflection (1)(2, n){3, n—1) . . ., 
respectively, that generate the dihedral group = {p, o") < Sn- Consider the 
conjugation map ip : Sn ^ Sym(S'„),x ^ x* , where x* : S'„ — )■ Sn,g ^ x~^gx. Then, 
ip is an injective group homomorphism since the center of Sn is trivial for n > 3 
(recall that we assumed that n > 4 since the n < 3 cases are easily dealt with). 
Hence, Z^an •= {p*y^*)y which is a subgroup of the group of inner automorphisms 
of 5"^, is isomorphic to D2n- Every element of D2n, when viewed as a permutation 
of the vertices of the Cayley graph Cay(5'„,5'), fixes the vertex e corresponding to 
the identity group element in Sn- Thus, the neighbors of the vertex e in the Cayley 
graph, namely the set of vertices S, is fixed setwise by each element in -D2„. In fact, 
p* maps si S2, S2 H- S3, . . . , Sn H- si, and a* interchanges si and s„, interchanges 
S2 and s„_i, and so on. Thus, D2n < Aut(5'„, S), and hence D2n < Gg. 

Since Lg < Ge, we have -D2n-^e < Ge- We now show that Ge < D2nLe- Let tt G Ge- 
Since vr fixes e, it induces a permutation of its neighbors 5*. Let r be the restriction 
of TT to S. We claim that r is an element of the dihedral group that acts as a group 
of automorphisms of the n-cycle graph with vertex set {si, . . . , s„}. To prove this, 
suppose r maps Si to Sj. Since S2 and s„ are the only edges in T{S) incident to Si, 
by Lemma [2] there are only two elements Sj of 5* that do not lie in unique 4-cycles 
passing through e, Si and Sj, namely the elements S2 and s„. Similarly, the only two 
elements Sk of S that do not lie in unique 4-cycles passing through e, Sj and Sk are 
the elements Sj_i and Sj+i. Thus, r maps the set {s2,s„} to {si_i,Si+i}. If r maps 
S2 to Sj+i, by a similar reasoning, it maps S3 to Si+2 or s,, but since si is mapped to 
Sj, S3 is mapped to Sj4.2. Continuing in this manner, we see that the action of r on 
S is that of a rotation that maps Sj to Sj+i. If r maps S2 to Sj_i, then by a similar 
reasoning, it maps S3 to Si_2, s„ to Sj+i, and so on, effecting the action of reflection 
on S. Thus, the action of any element of Ge on 5* is the same as the action of some 
element of the dihedral group obtained by restricting D2n to S. 

For any such r, since the restriction of Z^2n ^'^ ^ closed under inverses, there 
exists an element a G -D2n such that the action of the conjugation map a* G -D2n when 
restricted to S is the same as the action of on S. Thus, the action of a*7i G Ge 
on {e} U is the identity, i.e. a*n G Le. Hence, vr G D^^Le and Ge < D^^Le- 

Since Ge = D^^Le, D^^ n Le = 1, and by Biggs pj, Chapter 16] Le is a normal 
subgroup of Ge, we get that Ge = -^e x D^^. | 

Lemma 4. (Feng ^ Corollary 2.5]) Let S he a set of transpositions generating 
Sn satisfying the following condition for any two distinct transpositions t,k ^ S: 
tk = kt if and only if Caj{Sn, S) has a unique 4-cycle containing e,t and k, and if 
tk 7^ kt then Cay(S'„, S) has a unique 6-cycle containing e, t, k and a vertex at distance 
3 from e. Then Cay(S'„, S) is normal and has automorphism group isomorphic to 
RiSn)y<Ant{Sn,S). 

Theorem 5. Suppose the transposition graphT{S) is then-cycle graph, and letn > 4. 
Suppose Si,Sj G S are adjacent transpositions in T{S), and let T := Cay(5'n,5'). 
Then, there exists a unique 6-cycle in T containing e, Sj, Sj and some vertex of distance 
3 from e if and only if n ^ A. 
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Proof: Let Si = + 1) and Sj+i = (i + 1, i + 2) be two adjacent edges of the n-cycle 
graph T{S). We take the subscripts to be modulo n; for example, Sj = (n, 1) and 
Sj+i = (1,2) is possible. The sequence of 6 distinct vertices 

C := (e, Si, Sj+iSj, SjSj+iSj = Si-^iSiSi-^i = (i, i + 2), SiSj+i, s^+i, e) 

forms a 6-cycle in F. Also, the middle vertex SiSi^iSi = + 2) is not adjacent to e 
since T{S) does not have triangles, and the distance from {i,i + 2) to e is odd because 
r is bipartite and (i, i + 2) is an odd permutation. Hence, the distance from (i, i + 2) 
to e is equal to 3. Thus, F has at least one 6-cycle containing e, Si, Sj+i and some 
vertex at distance 3 from e. We now show that the condition that the 6-cycle contain 
e. Si, Sj+i and a vertex at distance 3 from e forces the uniqueness of this 6-cycle if and 
only if n 7^ 4. 

Let {e,Si,x,w,y,Si^i,e) be a 6-cycle in F. Then there exist integers k,r,s and 
£ such that x — s^Sj, w — s^SfeSj = SgS^Si^i, and y — s^Sj+i, where w has distance 
3 from e. The condition that the six vertices of the 6-cycle be distinct forces k ^ 

i,r 7^ k,s ^ r,l ^ s,£ ^ i + 1. We determine whether there is any other value of 
k, r, s and £ besides k = i + l,r = i,£ = i, s = i + 1 satisfying the two conditions that 
Sj+iSjSfc = siSgSr and the distance from w = SrSkSi = SsS^Sj+i to e is 3. 

We consider a few cases, depending on the value of k: 

Case 1: Suppose that k ^ {i — + l,i + 2}. Since Sj+iSj = + l,i + 2) 
has disjoint support from {k,k + 1), Si+iSiSk — s^SgSr implies that seSgSr is also the 
product of a transposition {k, k + 1) and a three-cycle permutation + l,i + 2). 
Since r ^ k, either £ = k or s = k. 

Suppose £ = k. Then s^^s,. = {i, i + l,i + 2). If the product of two transpositions 
is a permutation consisting of a single three-cycle, then the two transpositions must 
have overlapping support whose union is equal to the three elements of the cycle. 
Furthermore, since T{S) is the n-cycle graph and n > 4, T(S) does not contain any 
triangles, and so {i, i + 2) ^ S. This forces the equation SgSr = {i,i + l,i + 2) to have 
the unique solution s = i + l,r = i. But then w = SrSkSi = SiSkSi = Sk has distance 
1 from e, a contradiction. 

Suppose s — k. Then, we again have that s^s^ is the three-cycle + l,i + 2). 
As before, this implies that £ — i + 1 and r — i, a contradiction because I ^ i + 1. 

Case 2: Suppose k = i — 1. From the equations Sj+iSjSfc = s^s^s^ and = 
we get {i — + l,i + 2) = s^SsSr- If the product of three transpositions is a 

permutation consisting of a single four-cycle, then the transposition graph of these 
three transpositions is a spanning tree on the same four vertices whose support is 
the four-cycle. The transposition graph T{S) is the n-cycle graph, and so if n > 5, 
T{S) has a unique spanning tree on the vertex set {i — + l,i + 2}, namely the 
path graph containing the three edges {i — {i, i -|- 1) and (i + 1, i + 2); however, 
if n = 4, then {i — l,i + 2) E S is also an edge in T{S), which yields other spanning 
trees in T{S), such as the tree consisting of the three edges (i — 1, i -|- 2), (i -|- 1, i -|- 2) 
and {i, i + 1). 

If n > 5, the unique spanning tree given above forces {sj+i, Sj, Sk} = {se, Sg, Sr}; 
furthermore, the equation {i — l,i,i + l,i + 2) — s^SsSj. implies that £ — i + But this 
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is a contradiction because ^ ^ i + 1. Thus, if n > 5, there are no 6-cycles satisfying 
k^i-l. 

II n — A, then (i — 1, i + 2) e 5", the permutation (i — 1, i, i + 1, i + 2) can also 

be expressed as the product (i — l,i + 2)(i + l,i + + 1); thus the solution 

i = i + 2, s = i + l,r = i also satisfies the two conditions Si+iSjSfc = siSgSr and the 
distance from w to e is 3. Thus, the 6-cycle 

C := (e, Sj, = Sj+iSj_(-2Sj+i, Sj-|-2Si+i) ^i+i; c) 

also satisfies the conditions in the assertion; here (i — l,i + 1) = (i + l,i + 3) since 
i — 1 and i + 3 are identified with the same vertex of the 4-cycle. 

Thus, when n — A, there exists more than one 6-cycle in F that contains e, Sj, Sj+i 
and a vertex at distance 3 from e. Since non-uniqueness has now been established for 

n = 4, for the rest of the proof we may assume that n > 5. 

Case 3: Suppose k = i + 2. Then, Sj+iSjSfc = + l,i + 3,i + 2). As before, 
when n > 5, T{S) = Cn has a unique spanning tree containing any four consecutive 
vertices. The equation (i, i+l, i+3, i+2) — s^s^s^ implies {s£, Sg, s^} = {si, Sj+i, Si+2}. 
However, the only way to obtain the product + l,i + 3,i + 2) using these three 
generating transpositions is by having the first term equal Sj+i. But this is a 
contradiction because i ^ i + 1. 

Case 4: Suppose k = i + l. Here, we have Sj+iSjSj+i = SiSgSr- Again, since n > 5, 
the only way to achieve the product Si+iSjSj+i = + 2) using three transpositions 
from {sj, Sj+i, Sj_|_2} is either by the product SjSj+iSj or Sj+iSjSj+i. Since £ 7^ i + 1, we 
get i — i,s — i + l and r = i, yielding the unique 6-cycle C = (e, Sj, Sj+iSj, SiSj+iSi = 
Si+iSjSj+i = (i, i + 2), SiSj+i, Si+i, e) given earlier. 

Also, observe that when k = i + 1 and n = 4, we have {i + 3, i) G 5, and so the 
product {i,i + 2) has other decompositions such as 81+38^+25^+3. Thus we obtain the 
solution i — i + 3,s — i + 2,r — i + 3 — i — 1, and another 6-cycle 

C" •= (c, Sj, Sj+iSj, Sj_iSj+iSj = Sj+2Si-iSj+i, Sj_iSj+i, Sj+i, e). 

We have shown that: if n > 5, then k — i + 1 and there is a unique 6-cycle C in 
r containing e, Sj, Sj+i and a vertex at distance 3 from e; if n = 4, then there exist 
other 6-cycles besides C, such as C and C". | 

In the proof above, it was sufficient to just show the existence of three 6-cycles 
C, C and C" since non-uniqueness was all we needed to establish. A consideration 
of all possible solutions of the equation Sj+iSjSfe = seSgSr in the proof above gives the 
following result: 

Lemma 6. If Si, Sj+i G S are two adjacent edges in T(S) — C4, then there are exactly 
eight distinct 6-cycles in Cay(iS'4, 5*) that contain e, Si, Sj+i and a vertex at distance 3 
from e. The total number of vertices in 6-cycles of Cay(5'4, S) that contain e, Si and 
Sj+i and that are at distance 3 from e is exactly 6. 
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Proof: Let (e, Si, SkSi, SrSkSi = SsSgSi+i, s^Si+i, Sj+i, e) be a 6-cycle containing e, Si, Si+i 
and a vertex at distance 3 from e. Since these 6 vertices of the 6-cycle must be dis- 
tinct, we require that k ^ i,r ^ k,s ^ r,£ ^ s,i ^ i + 1. As in the proof above, the 
number of solutions to the equation siSsSr = Sj+iSjSfc is examined for different values 
of fc. 

As in the proof of Theorem O we consider different cases depending on the value 
of fc: 

Case 1: Suppose k ^ {i — + l,i + 2}. It has been shown in the proof above 
that there are no 6-cycles in this case. 

Case 2: Suppose k = i — If the product of three transpositions is a 4-cycle, then 
these three transpositions form a spanning tree in the transposition graph. Thus, 
SiSgSr = Sj+iSjSj_i = {i — + l,i + 2) implies that the set of edges {s^, s^Sr} 
of T{S) forms a spanning tree, and hence a path subgraph of T{S) = C4. Thus, 
the four possible solutions to the equation s^SsSr = Sj+iSjSj_i are S£ = Sj+i,Ss = 
Si, Sr = and the three cyclic shifts of this solution, i.e. (s^, Sg, Sr) can also equal 
(si+2, Si+i, Sj), (sj, Si+2) or Si+2, Si+i)- The first of these four solutions is 

not possible since i ^ i + The latter three solutions give rise to the following three 
6-cycles: 

71 = (s, Si, Si-iSi, SiSi-iSi = Si+iSi+2Si+l, Si^2Si+l, Si+1, e) 

72 = (C) Si, Si-iSi, Sj_|_2Sj_iSj = SjSj+i, Sj+i, e) 

73 = (e. Si, Si-iSi, = Si^2Si-iSi+i, Sj+i, e) 

Case 3: Suppose k = i + 2. In this case, the only solutions to seSgSr = Si+iSiSi+2 = 
+ 2,i + 3,i + 2) satisfying i i + 1 are {se,Ss,Sr) equals (si+2, Sj, Si+3) or 
{si, Si+2, Si+3). This gives the two 6-cycles 

74 = (e. Si, Si+2Si, Si+3Sj+2Sj = SiSi+2Si+l, Sj+2Sj+i, Sj+i, c) 

75 = (e. Si, Si+2Si, Si+3Sj+2Sj = Sj+2SjSj+i, SiSj+i, e) 

Case 4: Suppose = We require that siSgSr = .Sj+iSjSj+i = (i, i+2). The only 
way to express (i, z -|- 2) as a product of three transpositions from {si, Sj+i, Sj+2, 
is as Si+iSiSi+i, SiSi+iSi, Si+3Si+2Si+3 or Si+2Sj+3Si+2- Since ^ 7^ i + 1, only the latter 
three products are possible. From these three products, we obtain the following three 
6-cycles: 

76 (^5 Si, Sj_|_xSj, SjSj_|_xSj Sj_|_iSjSj_|_x, SjSj_|_x, "Sj^f-x, c) 

77 = (e, Sj, Sj+iSj, Sj+3Sj+iSj = Sj_|_2'5i+3'5i+l5 Sj+sSj+i, Sj_|_i, e) 

78 = (e, Sj, Sj+iSj, Sj+2Sj+iSj = Sj+3Si+2Sj+i, Si+2Si+i, Sj+i, e) 

Thus, there are exactly eight distinct 6-cycles containing e, and a vertex 

at distance 3 from e. The number of vertices in these 8 cycles that are at distance 
3 from e is exactly 6 since the middle vertices in 74 and 75 are the same, and the 
middle vertices in 73 and 77 are the same (the vertex z — 1 is identified with i + 3 
since T{S) = C4, and Sj+i and commute). | 

Theorem 7. Let S be a set of transpositions in Sn such that the transposition graph 
T{S) is the n-cycle graph. Let denote the stabilizer of a vertex neighborhood in 
Cay(S'„, S). Then, is trivial if and only ifn 7^ 4, and is isomorphic to the Klein 
4-group Z2 X Z2 i/n = 4. 
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Figure 1: The Cayley graph Cay(5'4, S) when the transposition graph T{S) is a 4- 
cycle. 

Proof: Let T{S) be the n-cycle graph, and let Le denote the set of automorphisms 
of r := Cay(S'„, S) that fixes the vertex e and each of its neighbors. Define Ti{e) to 
be the set of vertices of F that have distance i to vertex e. 

First consider the case n = 4. In this case, Cay(S'4, S) is the graph shown in 
Figure [H The figure of this graph can be obtained by, say, letting vertex 1 represent 
the identity element e in 5*4, and letting vertices 2,3,4 and 5 correspond to the 
generators si,S2,S3 and S4, respectively. For example, vertex 11 corresponds to the 
element S2S4 = S4S2. We now prove that Lg = Z2 x Z2. 



Let vr G Lg. Thus, the action of vr on the vertex set {1,2,3,4,5} is the identity. 
By Lemma m there is a unique 4-cycle in F containing vertices 1, 4 and 2, namely 
the cycle (1,4,6,2, 1), and a unique 4-cycle containing 1, 3 and 5, namely the cycle 
(1, 3, 11, 5, 1). Hence, since vr G Le fixes each Sj, vr fixes 6 and 11 also. Since 24 is the 
unique vertex at maximum distance from 1, tt fixes 24 also. Note that vr fixes 4 and 
hence permutes its neighbors {1, 12, 6, 13}, of which vr fixes 1 and 6. Hence, {12, 13} 
is a fixed block of vr. Similarly, we get that {9, 10}, {7, 8} and {14, 15} are also fixed 
blocks of 71. Also, the vertices in F3(l) that are not neighbors of 24, i.e. the vertices 
{16, 17, 21, 22} also form a fixed block of vr. 

Now 71 either fixes {12, 13} pointwise or interchanges 12 and 13. Thus, tt either 
fixes their neighbors in F3(l) (i.e. the sets {16, 18, 17} and {21, 22, 18} are each fixed 
blocks of tt) or vr induces a bijection between these two sets. In either case, 18 is the 
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only vertex from these two sets that is adjacent to 24. Hence, tt fixes 18. By a similar 
argument (that tt either fixes {9, 10} pointwise or interchanges 9 and 10), we get that 
TT fixes 20. The neighbors of 6 in r3(l) form a fixed block of tt, and so tt fixes {19, 20} 
and hence fixes 19 as well. Since the neighbors of 11 arc {3. 5, 18, 23} and tt fixes 11 
and three of its neighbors, vr also fixes the remaining neighbor 23. Thus, if tt € Lg, 
then the action of tt on {1, 2, 3, 4, 5, 6, 11, 18, 19, 20, 23} is the identity. 

Now {12, 13} is a fixed block of tt. We consider 2 cases, depending on whether tt 
interchanges 12 and 13 or whether tt fixes {12, 13} pointwise: 

Case 1: Suppose n interchanges 12 and 13. Then n induces a bijection between 
the neighbors (16, 18, 17} of 12 and the neighbors (18, 21, 22} of 13. Since tt fixes 18, 
it induces a bijection between {16, 17} and {21, 22}. 

Case 1.1: Suppose tt maps 16 to 21. Then tt : 17 i-> 22. So tt maps the 
neighbors {16, 9, 8, 14} of 16 to the neighbors {13, 9, 7, 14} of 21. But {9, 10} is 
a fixed block of vr, hence vr : 9 i-^ 9, 8 H- 7, 7 i-^ 8, 14 i-^ 14, 15 15. Since 
the neighbors {16,21,20} of 9 are permuted by tt, we have vr : 21 i— )> 16. Hence 
TT : 22 ^ 17. Thus, tt = (12, 13)(16, 21)(22, 17)(7, 8). Denote this permutation by 
TTi := (12,13)(16,21)(22,17)(7,8). 

Case 1.2: Suppose tt : 16 i-)- 22. Hence tt : 17 i-)- 21. So tt maps the neighbors 
{12,9,8,14} of 16 to the neighbors {13,10,7,15} of 22. By the conditions above, 
TT : 12 h-^ 13,9 h-^ 10 (hence 10 9), 8 f-> 7 (hence 7 ^ 8), and 14 15 (hence 
15 I—)- 14). Since n interchanges 7 and 8, tt induces a bijection between their neighbors 
{21, 22, 23} and {16, 17, 23}. Since tt fixes 23, it induces a bijection between {21, 22} 
and {16, 17}. We know tt : 16 i-> 22, 17 i-)- 21. We consider two subcases: 

Case 1.2.1: tt : 22 17,21 H- 16. So the permutation vr contains (16,22,17,21) 
as a cycle. In this case, vr maps the neighbors {12,9,8, 14} of 16 to the neighbors 
{13,10,7,15} of 22 and the neighbors of 22 to the neighbors {12,10,8,15} of 17. 
The first restriction imphes tt : 9 i-> 10, and the second imphes tt : 10 i-> 10, an 
impossibility. Hence, this subcase is not possible. 

Case 1.2.2: vr interchanges 16 and 22, and it interchanges 17 and 21. In this case, 
vr = (12, 13)(9, 10)(8,7)(14, 15)(21,17)(16,22). Denote this permutation by vra := 
(12, 13)(9, 10)(8, 7)(14, 15)(21, 17)(16, 22). 

Case 2: Suppose tt : 12 i-> 12, 13 i-> 13. Then the neighbors {16, 17} of 12 are a 
fixed block of vr. 

Case 2.1: If vr fixes 16, then the set of its neighbors {12, 9, 8, 14} is a fixed block 
of vr, and hence is fixed by vr pointwise since each of 9, 8 and 14 are already known 
to lie in different fixed blocks of vr. Hence, tt also fixes 10, 7, and 15. Also, tt fixes 
17 since it fixes the neighbors {16, 18, 17} of 12 and since 16 and 18 are fixed points. 
Also, the neighbors {17, 19, 22} of 15, and hence 22, and the neighbors {21, 19, 16} of 
14, and hence also 21, are all fixed by vr. Thus, vr is the identity clement. 

Case 2.2: If vr : 16 i~> 17, then 17 16. So vr induces a bijection between their 
neighbors {12, 9, 8, 14} and {12, 10, 8, 15}. We know 12 ^ 12, so 9 ^ 10, and hence 
10 9. Similarly, 8 8 (hence 7 7), and 14 ^ 15, 15 ^ 14. Since {16, 17, 21, 22} 
is a fixed block, {21,22} is also a fixed block. If vr : 21 i-> 21, then its neighbors 
{13, 9, 7, 14} form a fixed block, meaning 9 is a fixed point, a contradiction. Hence, 
vr : 21 ^ 22,22 ^ 21, and we get that tt = (9, 10)(16, 17)(14, 15)(21, 22), which is 



10 



seen to equal 7ri7r2. 

Thus, the only elements in Lg are tti (Case 1.1), tt2 (Case 1.2.2), the identity 
element (Case 2.1), and 7111^2 (Case 2.2). The order of tti and 7T2 is 2; thus, is 
isomorphic to the Klein 4- group Z2 x Z2. 

Now consider the case n > 5. Let tt G L^, and let t,k ^ S. lit and k have disjoint 
support, then by Lemma [2] there is a unique 4-cycle in F containing e,t and k. Since 
vr is an automorphism of F that fixes e, t and k, and since t/c is the only other common 
neighbor of t and k besides e, vr fixes tfc also. If t and A; have overlapping support, 
then by Theorem [5] there is a unique 6-cycle in F containing e, t, k and a vertex at 
distance 3 from e. Hence, any automorphism of F fixing e, t and k must also fix this 
6-cycle (and hence fix this 6-cycle pointwise since it fixes three of the elements in this 
6-cycle), which contains tk. Thus, vr fixes tk. Thus, if vr G Lg and Si, S2 G S, then vr 
also fixes S1S2. 

It now suffices to prove that vr fixes an arbitrary vertex S1S2 ■ ■ ■ s^, and this can be 
shown by induction. Assume this assertion holds for smaller values of k. Define z = 
S3 ■ ■ ■ Sfc, and let : Sn ^ Sn, g ^ gz he right translation by z. Then ip := Vz'nr^-i is 
a composition of automorphisms of the Cayley graph F and hence an automorphism 
of F. By the inductive hypothesis, = e^^'^^^'^ = z'^^^~^ = z^^-^, which equals e. 
Hence, ip fixes e. Also, ip fixes Si E S because sf = s^"^"^''^ = (sjSa ■ ■ ■ Sfc)'^^^~^ = 
(sjSs ■ ■ ■ SkY^-^ (by the inductive hypothesis), which equals Sj. Thus, ip G L^, and by 
the previous paragraph {siS2)^ = S1S2. But this is equivalent to the assertion that ip 
fixes the element Si . . . Sk because (5152)''"''^^^"^ = S1S2 iff {siS2zY = {siS2z). | 

By the results proved thus far, it follows that: 

Corollary 8. Let S be a set of transpositions in S'„. If the transposition graph T{S) is 
a 4-cycle, then the automorphism group of the Cayley graph Cay(S'4, S) is isomorphic 
to R{S4)Ge = R{S4){Le XI Dg) = R{S^{Vi X D^), and R^S^) is not a normal subgroup 
of the automorphism group 0/ Cay (6*4, 5). IfT{S) is the n-cycle graph, where n>5, 
then the automorphism group of Cay(5'„, S) is the semidirect product R{Sn) x D2n- 

Theorem 9. Let S be a set of transpositions generating Sn, and let F be the Cayley 
graph Caj{Sn, S) . Let k,t E S be distinct transpositions. If tk ^ kt and the girth 
of the transposition graph T{S) is at least 5, then there is a unique 6-cycle in F 
containing e,t, k and a vertex at distance 3 from e. Moreover, ifT{S) does contain a 
4-cycle, then there exist t,k E S such that tk ^ kt and such that there does not exist 
a unique 6-cycle in F containing e, t, k and a vertex at distance 3 from e. 

Proof: Suppose T{S) does not contain triangles or 4-cycles, and let t,k E S he 
distinct transpositions such that tk 7^ kt. We show that there is a unique 6-cycle in 
F containing e,t,k and a vertex at distance 3 from e. Since tk 7^ kt, t and k are 
adjacent edges in T{S), so we may assume without loss of generality that k = (1,2) 
and if: = (2, 3). Then, (e, t, kt, tkt = ktk, tk, k, e) is a 6-cycle in F. The distance from e 
to tkt is at most 3. Also, F is a bipartite graph with bipartition equal to the even and 
odd permutations, and so the distance from e to tkt is odd. But this distance cannot 
be 1 since tkt = (1,3) ^ S because T{S) has no triangles. Thus, tkt has distance 3 
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to e. We show next that this 6-cycle is the unique 6-cycle in T containing e, t, k and 
a vertex at distance 3 from e. 

Suppose {e,t,tit,t2tit = k2kik,kik,k,e) is a 6-cycle in F containing e,t,k and a 
vertex at distance 3 from e. Since the 6 vertices in this 6-cycle are distinct, we have 
that ti 7^ t, ^2 7^ ^1, ^2 7^ ^2, ^2 7^ ki and /ci 7^ fc. We first show that ki = t = (2, 3). 
Suppose ki 7^ (2,3). We know ki ^ k = (1,2) and since T(S') has no triangles, 
ki 7^ (1, 3). Thus, {1, 2, 3} and the support of ki have an intersection of size at most 
1. (For example, if ki = (1,4) say, then the intersection is {1}, and if ki = (4,5) 
say, then the intersection is trivial.) This implies that the union of {1,2,3} and the 
support of ki is at least 4 because ki contributes at least one new element to this 
union. By ^2^1^ = ^2^1^, we have ^2^2^! = kikt. We now prove that the assumption 
that T{S) have girth at least 5 forces {^2,^2,^1} = {ki,k,t}. Now ki 7^ (2,3) since 
T{S) does not contain triangles, and k and t have total support {1,2,3}. 

Suppose ki has overlapping support with {1, 2, 3}. This can happen if and only if 
the three edges {fci, k, t} form a tree spanning 4 distinct vertices of T{S), namely the 
vertices {l,2,3,i} for some i. The product kikt of three transpositions that form a 
subtree in T{S) is a permutation that consists of a single four-cycle, and conversely 
(cf. Godsil and Royle [3 Lemma 3.10.2]), if the product of three transpositions is 
a four-cycle, then these 3 transpositions constitute the edges of a spanning tree on 
the same 4 vertices corresponding to the support of the four-cycle. Thus, the edges 
{^2, ^2, ^1} also form a spanning tree on the same 4 vertices {1, 2, 3, i}. Now, the only 
spanning tree subgraph in T{S) on these 4 vertices is the spanning tree {ki,k,t} 
because T{S) does not contain triangles or 4-cycles. Thus, {^2,^2,^1} = {ki,k,t}. 
The rest of this proof of the uniqueness of 6-cycles follows the proof in pi p. 71]. 

If ki has disjoint support from {1,2,3}, then the product kikt has a 2-cycle, say 
and a 3-cycle kt = (1,3,2), the two cycles being disjoint. By ^2^2^! = kikt, we 
have that at least one of /c2, ^2 or ti must equal and the product of the other two 
must equal (1, 3, 2). Since T{S) has no triangles, the only way to decompose (1, 3, 2) 
as a product of two transpositions from S is as (1, 2) (2, 3) = kt. Thus, two of k2, t2, ti 
must equal k and t, and so we again get {^2,^2,^1} = {^1, k,t}. 

Thus, if T{S) does not contain triangles or 4-cycles and ki 7^ (2,3), then the 
union of the support of ki,k and t is at least 4, and hence ^2^2^! = kikt forces 
{k2, t2, ti} = {ki, k, t}. A few cases now arise, each of which is seen to be impossible: 

We already have k2 ^ ki. We consider the two cases k2 = k and k2 = t: 

Case 1: k2 = k. Then, either t2 = ki and ti = t ot t2 = t and ti = ki. The 
first subcase is impossible because ti 7^ t. The second subcase t2 = t and ti = ki, 
along with ^2^2^! = kikt gives ktki = kikt, i.e. ki = (1, 2, 3)A;i(l, 3, 2). This equation 
implies that the support of ki is disjoint from {1,2,3}, and so k2kik = k2kki = 
ki G S, implying that the vertex k2kik is at distance 1 and not distance 3 from e, a 
contradiction. 

Case 2: k2 = t: Then we have two subcases - that either t2 = ki and ti = k or 
t2 = k and ti = ki. In the first subcase, /c2^2^i = kikt gives ki = (2, 3)A;i(l, 3). This 
equation has no solutions. For if 1 is not in the support of ki, then ki doesn't move 
1 but the right side does. Since ki moves 1, 2 and 3 are not in the support of ki 
(because ki ^ (1, 2), (1, 3)). So ki = (2, 3)A;i(l, 3) = A;i(2, 3)(1, 3) = A;i(l,3,2), an 
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impossibility. In the second subcase, we get ki = (1, 3, 2)A;i(l, 3, 2). This equation 
also has no solutions. For if the support of ki is disjoint from {1, 2, 3}, then the right 
side becomes A;i(l,2,3), which cannot equal ki. And if the support of ki overlaps 
with {1,2,3}, say ki = then the left side maps i to 1, whereas the right side 

maps ? to 3. 

Thus, ki = (2, 3) = t. 

In a similar manner, it can be shown that ti = (1, 2) = k. For if ti ^ (1, 2), then 
since ti ^ t = (2,3) and since ti ^ (1,3) {T{S) has no triangles), we have that the 
union of the support of ti,k and t is at least 4. As before, if T{S) does not have 
triangles or 4-cycles, then the equation ^2^2^! = titk implies {t2,k2,ki} = {ti,t,k}. 
We already have ^2 7^ ^i- We consider the two cases t2 = t and t2 = k separately: 

Case 1: t2 = t: The subcase k2 = ti, ki = k is not possible since ki ^ k. li k2 = k 
and ki = ti, then k2kik = t2tit gives ti = (1, 3, 2)ti(l, 2, 3). Thus, ti has support 
disjoint from {1,2,3}, giving that t2tit = t2tti = ttti = ti G S*, a contradiction 
because the vertex t2tit is required to be at distance 3 from e. 

Case 2: t2 = k. Consider first the subcase k2 = ti, ki = t. By ^2^1^ = htit, we get 
titk = ktit, i.e. ti = ktitkt = (1, 2)ti(l, 3). This equation has no solutions, for if the 
support of ti is disjoint from {1,2,3}, then the equation becomes ti = ti(l, 2)(1, 3), 
which is impossible. If ti has support overlapping with {1,2,3}, say ti = (l,i) 
{i 7^ 1,2,3), then the left side and right side map i to different points. Similarly, 
ti 7^ (2,i), {3,i). The second subcase is k2 = t,ki = ti. Then, by ^2^1^ = ^2^1^, we 
get ttik = ktit, or ti = (1, 2, 3)ti(l, 2, 3). Again, in each of the cases where ti has 
support overlapping with {1,2,3} and support disjoint from {1,2,3}, it is seen that 
the equation has no solutions. 

This proves that t2 = (1,2). Thus, ^2^1^ = ^2^1^ becomes k2tk = t2kt, or t2^2 = 
ktkt = (1, 2, 3). Since T(S) has no triangles, the only way to express (1, 2, 3) = tk as 
a product of two transpositions ^2^2 is as ^2 = ^, ^2 = k. This gives rise to the same 
6-cycle given initially, and hence there exists only 6-cycle in F containing e, t, k and 
a vertex at distance 3 from e. 

To prove the second part of the theorem, note that if T{S) contains a 4-cycle, then 
F = Cay(S'„, S) contains the modified bubble-sort graph MBS^ as a subgraph; here 
MBS4 denotes the Cayley graph of the group S4 generated by 4 cyclically adjacent 
transpositions. If t and k are adjacent transpositions in the 4-cycle T{S), then by 
Theorem [5|, the subgraph MBS4 has more than one 6-cycle containing e, t, k and 
a vertex at distance 3 from e. Thus, the Cayley graph Cay(S'„, 5), which contains 
MB 84^ as a subgraph, also has more than one 6-cycle containing e, t, k and a vertex 
at distance 3 from e. | 

From Lemma m and Theorem [9], it follows that a sufficient condition for normality 
of Cay(S'„, 5") is that the transposition graph T{S) have girth at least 5: 

Corollary 10. Let S be a set of transpositions generating Sn such that the girth of the 
transposition graph T{S) is at least 5. Then, the automorphism group of the Cayley 
graph Cay(S'„, S) is the semidirect product R{Sn) xi Aut(S'„, S). 
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A special case of this Corollary whereby T{S) is a tree gives the result of Feng [3] 
that the automorphism group of a Cayley graph generated by a transposition tree is 
isomorphic to R{Sn) x Aut(S'„, S). 
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